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© CODING AND DECODING DEVICE FOR TIME- VARYING IMAGE. 



© A coding and decoding device for a time-varying 
picture, by which a high picture quality is obtained 
from a smaller amount of information than a system 
using only DCT coding. The efficiency of coding can 
be increased and the block distortion of a composite 
image is reduced. An image is divided into several 
blocks, and each block is coded. At this time dis- 



crete cosine transformation coding (DCT) and in- 
trablock predictive composing (NTC) are switched 
over to each other adequately according to the prop- 
erty of the image pattern. When the intrablock pre- 
dictive composing is executed, the predictive value 
and quantization width of a block are transmitted. 
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Technical Field 

This invention relates to a motion picture en- 
coding and decoding system, and more particularly 
to a system, which permits transmission of motion 
picture signal by compressing the same. 

Background Art 

As typical motion picture encoding system, 
there are those of two-dimensional discrete cosine 
transform (DOT) coding method and predictive 
coding method. 

In the discrete cosine transform (DCT) coding 
method, signal power is concentrated in predeter- 
mined frequency components making use of the 
fact that picture signal has two-dimensional correl- 
ative property. The resultant distribution of signal 
power frequency components is coded by express- 
ing information to be transmitted with coefficients, 
and in this way frequency of information can be 
compressed. 

For example, with a flat pattern portion, in 
which the motion picture signal is highly self-correl- 
ative, the discrete cosine transform coefficients 
(DCT coefficients) are distributed such that they 
are concentrated in low frequency components. 
Thus, in this case information to be transmitted can 
be expressed by merely coding the coefficients 
distributed such as to be concentrated in a low 
frequency region, thus permitting compression of 
information. 

With the discrete cosine transform method, 
however, if discontinuous points of such signal as 
picture signal including contours (or edges) are to 
be transmitted by accurately expressing them with 
DCT coefficients, the generated DCT coefficients 
are distributed broadly from low to high frequency 
components. Therefore, an extremely large number 
of coefficients are required, thus reducing the cod- 
ing efficiency. 

To solve this problem, a method of coarsening 
the coefficient quantizing characteristic or discard- 
ing high frequency component coefficients has 
been used for high compression coding motion 
pictures. These measures, however, are still insuffi- 
cient in that the motion picture signal is deterio- 
rated pronouncedly. For example, a distortion like a 
waver (which is called corona effect mosquito 
noise) is generated around the contour. 

The predictive coding method, on the other 
hand, makes use, for coarsening the quantizing 
characteristic, of the eye's character that the bright- 
ness discrimination degree is low for contour por- 
tions of motion picture, and it has an advantage 
that it permits comparatively high compression 
coding. In this method, however, coarsening the 
quantizing characteristic for flat portions of motion 



picture, is liable to result in visually pronounced 
deterioration, such as generation of false contours 
or particle-like noises. Therefore, the predictive 
coding is not suited as means for high compres- 

5 sion coding of flat portions. 

Accordingly, it has been contemplated to let 
the discrete cosine transform (DCT) and predictive 
coding methods mutually make up for their 
drawbacks, that is, to switch the discrete cosine 

to transform (DCT) and intra-block discrete cosine 
transform methods for each unit block according to 
the character of the pattern for high compression 
coding. More specifically, it is through that the 
discrete cosine transform (DCT) method may be 

75 used for a flat block of picture, while using the 
intra-block predictive coding (or NTC, the intra- 
block non-transform coding) for a contour portion of 
picture. 

In the block-by-block intra-block predictive cod- 
20 ing (NTC), there is a problem of block distortion 
which is generated when the quantizing is made 
coarsely. Specifically, this is a mosaic-like phenom- 
enon produced for each block as a result of the 
coding. 

25 In the intra-block predictive coding (NTC), 

quantizing errors generated as a result of coarse 
quantizing directly appear as brightness level 
changes (or deterioration). If great brightness level 
changes appear aJong the boundary between adja- 

30 cent blocks, the shape of the blocks is pronounced 
visually like a mosaic. 

Disclosure of Invention 

35 In view of the foregoing, an object of this 

invention is to provide a motion picture coding and 
decoding system, which permits block-by-block 
transmission of compression coded data of motion 
pictures without causing block distortion of de- 

40 coded motion pictures. 

The foregoing objects and other objects of the 
invention have been achieved by the provision of 
the motion picture encoding and decoding appara- 
tus wherein: when coding a frame of motion picture 

45 by dividing the frame into a plurality of blocks for 
block-by-block coding, the discrete cosine trans- 
form coding and intra-block predictive coding are 
adaptively switched according to the character of 
the pattern. 

so The discrete cosine transform (DCT) coding 

system is firstly used for flat portions of the motion 
picture. At this time, even by effecting coarse 
quantizing with the DCT coding method, it is possi- 
ble to obtain for the decoded motion picture a 

55 smoothness corresponding to the accuracy of cal- 
culation at the time of the discrete cosine trans- 
form. The intra-block predictive coding (NTC) 
method is secondly used for contour portions of 
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the motion picture. At this time, for reducing block 
distortion resulting from coarse quantizing, adaptive 
quantizing is effected by transmitting data of a 
typical value BASE1 of block and the quantizing 
width Q t or the typical value BASE1 of block, the 
difference D between the typical value BASE1 and 
another typical value BASE2 and the quantizing 
width Q. In the decoding system, picture is de- 
coded by using the typical value BASE1 of block 
and quantizing width Q or the typical value BASE1 
of block, difference D and quantizing width Q along 
with switching information. 

In the motion picture coding apparatus accord- 
ing to the invention, in which intra- and inter-picture 
coding modes are used, the coding mode is 
switched to the DCT or intra-block predictive cod- 
ing mode for each unit area <or a block) of intra- or 
inter-picture signal. 

Switching between the discrete cosine trans- 
form (DCT) coding and intra-block predictive cod- 
ing (NTC) is thus permitted by providing the con- 
vention motion picture coding method, which has 
the function of discrete cosine transform (DCT) 
coding alone, a switching information flat specifying 
either DCT or NTC for each block to be coded or 
providing a NTC mode by expanding specifying 
information specifying a mode of unit area {or 
macro-block) coding. 

In this way, it is possible to obtain higher 
efficiency coding of motion picture and also decod- 
ing to reproduce higher picture quality motion pic- 
ture according to the high efficiency coded data. 

As above, according to the invention the intra- 
block predictive coding is selected for the coding 
of contour portion of pictures, so that coding with 
less mosquito noise or like interference can be 
obtained with substantially the same or less 
amount of information as that in the case of the 
discrete cosine transform coding, and high picture 
quality can be obtained with less amount of in- 
formation as a whole compared to the system 
having only the discrete cosine transform coding 
function. 

Further, when effecting the intra-block predic- 
tive coding, the block distortion of the decoded 
picture can be reduced by effecting adaptive quan- 
tizing by transmitting a typical value of block and 
quantizing width or a typical value BASE1 of block, 
the difference between the typical value BASE and 
another typical value BASE' of block and the quan- 
tizing width. 

It is possible to further increase the coding 
efficiency by adaptively switching the order of call - 
out of coefficients after the quantizing and, if nec- 
essary, further carrying out a coefficient differenti- 
ation process- 



Brief Description of Drawings 

Fig. 1 is a block diagram showing one embodi- 
ment of a encoder of the invention; 

5 Fig. 2 is a block diagram showing one embodi- 

ment of a decoder of the Invention; 
Fig. 3 is a schematic view showing the proce- 
dure of coding DCT coefficients; 
Fig, 4 is a schematic view showing the proce- 

10 dure of call-out of coefficients; 

Fig. 5 is a schematic view showing the proce- 
dure of intra-block predictive coding; 
Fig. 6 is a graph showing a characteristic curve 
when using mean values; 

is Fig. 7 is a graph showing a characteristic curve 
of quantizing and decoding when using means 
values; 

Fig. 8 is a grap"h showing a characteristic curve 
in an example of block distortion when using 
20 mean values; 

Fig. 9 is a graph showing a characteristic curve 
when using ADRC; 

Fig. 10 is a graph showing a characteristic curve 
in an example of block distortion when using 

25 ADRC; 

Fig. 11 is a graph showing a characteristic curve 
in first edge matching quantizing method; 
Fig. 12 is a graph showing a characteristic curve 
in the first edge matching quantizing method; 

30 Fig. 13 is a graph showing a characteristic curve 
in second edge matching quantizing method; 
Fig. 14 is a schematic view showing an example 
of data scan path used for NTC; 
Fig. 15 is an algorithm in an example of selec- 

35 tion of data scan path used for NTC; 

Fig. 16 is a connection diagram showing a dif- 
ferential coding circuit; 

Fig. 17 is a schematic view showing a different 
procedure of intra-block predictive coding; 
40 Fig. 18 is a schematic view showing the relation 
between an edge and DCT coefficient; 
Fig. 19 is a flow chart showing the procedure of 
coding method selection; 

Fig. 20 is a flow chart showing a contour block 
46 detection sub-routine; 

Fig, 21 is an algorithm in an example of DCT 

coefficient concentration degree calculation; 

Fig. 22 is a schematic view showing positions of 

intra-block pixels used for the estimation of a 
50 typical value of block; 

Fig. 23 is a schematic view showing memory 

data after processing; 

Fig. 24 is an algorithm in the definition of a 
DCT/NTC judgment method with C language; 
55 Fig. 25 is an algorithm subsequent to the view 
of Fig. 24, showing the algorithm in the defini- 
tion of the DCT/NTC judgment method with C 
language; 
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Fig. 26 is an algorithm subsequent to the view 
of Fig. 25, showing the algorithm in the defini- 
tion of the DCT/NTC judgment method with C 
language; 

Fig. 27 is an algorithm subsequent to the view 
of Fig. 26, showing the algorithm In the defini- 
tion of the DCT/NTC judgment method with C 
language; 

Fig. 28 is an algorithm subsequent to the view 
of Fig. 27, showing the algorithm in the defini- 
tion of the DCT/NTC judgment method with C 
language; 

Fig. 29 is a signal waveform diagram showing 
an example of block picture signal including 
contour; 

Fig. 30 is a schematic view showing an example 
of the transmission of DCT/NTC switching in- 
formation; 

Fig. 31 is a schematic view showing an example 
of the transmission of intra-biock typical value; 
and 

Fig. 32 is a connection diagram showing an 
inverse differential coding unit. 

Best Mode for Carrying Out the Invention 

Preferred embodiments of this invention will be 
described with reference to the accompanying 
drawings: 

(1) General Construction 

Referring to Fig. 1, DV1 generally designates 
an encoding system. A digital input motion picture 
signal is blocked by a blocking circuit (not shown) 
into blocks each consisting of, for instance, 8 by 8 
pixels to be input as block digital input picture 
signal D IN) which is processed through a discrete 
cosine transform (DCT) coding unit 1, an intra- 
block predictive coding (NTC) unit 2 and a coding 
method switching judgment unit 3. 

More specifically, the signal D !N is fed to a 
predictor 5 and a difference calculator 8. The pre- 
dictor 5 provides a predicted signal S1. The dif- 
ference calculator 8 performs either intra- or inter- 
frame coding to obtain a difference signal S2 be- 
tween the predicted signal Si and the block digital 
input picture signal Dm, the difference signal S2 
being fed to the discrete cosine transform (DCT) 
coding unit 1 and the intra-biock predictive coding 
(NTC) unit 2. 

While this embodiment concerns a case of 
performing either intra- or inter-frame coding, it is 
possible to permit intra- or inter-field coding as 
well. In general, it may be applied either intra- or 
inter-picture fi e., intra- or inter-frame, or intra-or 
inter-field) coding. 



In the discrete cosine transform (DCT) coding 
unit 1. a discrete cosine transform (DCT) circuit 11 
performs discrete cosine transform of the differ- 
ence signal S2 to obtain a discrete cosine trans- 

5 form signal S3. A first quantizer 12 then quantizes 
the signal S3 to obtain a quantized signal S4, 
which is passed through a delay circuit 13 to a 
discrete cosine transform (DCT) input terminal "a" 
of a first selector 4A. 

10 The first selector 4A outputs a selection output 

55, which is converted in a variable length coding 
(VLC) unit 6 together with transmission manage- 
ment data S7 into a variable length coded signal 

56, which is tentatively stored in a buffer 7. The 
T5 buffer 7 sends out transmission data D 0 ur at a rate 

matched to the transmission rate of transmission 
system 8 such as transmission line and recorder. 

The quantized signal S4 from the first quantizer 
12 is inversely converted through a first inverse 

20 quantizer 14 and an inverse discrete cosine trans- 
form (OCT) C i rcu it 15 to be fed back through the 
discrete cosine transform coding input terminal a of 
a second selector 4B to the predictor 5. Thus, the 
predictor 5 reproduces an immediately preceding 

25 predictive picture frame represented by the vari- 
able length coded signal S6 fed to the buffer 7, the 
reproduced predictive picture being fed as the pre- 
dicted signal S1 to the difference calculator 8. 

When generating the predicted signal S1, the 

30 predictor 5 generates management data represent- 
ing motion vector, prediction mode, calculation 
method (of intra-Zirrter-frame coding) in the differ- 
ence calculator 8, these data being fed as the 
transmission management signal S7 to the variable 

as length coding unit 6 for coding together with the 
data of the selection output S5 into the variable 
length coded signal S6. 

As the discrete cosine transform (DCT) coding 
unit 1 can be used one, which is shown in, for 

40 instance, "lntra-/lnter- Frame External/Internal Pre- 
dictive Coding of HDTV Signals *, the Transactions 
of Institute of Electronics and Communication En- 
gineers Japan Section, 1987/1, Vol. J70-B, No. 1. 
p-p. 96-104, or one, which is shown in Japanese 

45 Patent Application No. 410247/1990. 

In the intra-biock predictive coding (NTC) unit 
2, the difference signal S2 from the difference 
calculator 8 is fed to an intra-biock predictor 21. 
The intra-biock predictor 21 derives a typical value 

so of block with respect to this difference signal S2 
and obtains a difference signal of the typical value 
from each pixel value. The difference signal is fed 
as a predictive coding signal S10 to a second 
quantizer 22 for conversion into a quantized signal 

55 S11 to be fed to scan converter 23. 

The scan converter 23 rearranges the pixel 
data of the quantized signal S11 to permit further 
data compression, the rearranged quantized signal 



5 



EP 0 549 813 A1 



S12 being fed through a differentiation input termi- 
nal "c" of a switch 27 A to a differentiator 24. The 
differentiator 24 outputs a differentiation output S13 
which is fed through a switch 27 B to an intra-block 
predictive coding input terminal n b w of the first 
selector 4A. 

Trie switches 27A and 27B are adapted such 
as to bypass, if necessary, the differentiator 24 to 
feed the rearranged quantized signal $12 through 
their bypass side terminals "d" to the intra-block 
predictive coding (NTC) input terminal w b" of the 
first selector 4A. 

Thus, compressed picture data obtained 
through intra-block predictive coding of the dif- 
ference signal $2 is fed through the variable length 
coding unit 6 to the buffer 7. 

The delay circuit 13 is used to match the 
process time in the discrete cosine transform 
(DCT) coding unit 1 to that in the intra-block pre- 
dictive coding (NTC) unit 2. 

The quantized signal S11 from the second 
quantizer 22 is inversely converted through a sec- 
ond inverse quantizer 25 and inverse intra-biock 
predictor 26 into a predictive difference signal S14 
to be fed back through a predictive coding input 
terminal "b" of the second selector 4B to the 
predictor 5. The predictor 5 reproduces the imme- 
diately preceding picture frame represented by the 
variable length coded signal S6 fed to the buffer 7, 
thus obtaining the predicted signal Si. 

The difference signal S2 of the difference cal- 
culator 8 and the discrete cosine transform signal 
S3 of the discrete cosine transform circuit 11 are 
further fed to the coding method switching judg- 
ment unit 3. The unit 3 thus effects judgment as to 
whether the discrete cosine transform of the intra- 
block pattern is disadvantageous for the data com- 
pression factor, thus generating a coding method 
switching signal S20. If the discrete cosine trans- 
form method selected at present is advantageous, 
the first and second selectors 4A and 4B are 
switched to the side of the discrete cosine trans- 
form coding input terminal a to cause the discrete 
cosine transform coding unit 1 to execute the cod- 
ing of the difference signal S2. 

If the discrete cosine transform method se- 
lected at present is disadvantageous for the data 
compression factor, on the other hand, the coding 
method switching judgment unit 3 switches the first 
and second selectors 4A and 4B to the side of the 
intra-block predictive coding input terminal "b" ac- 
cording to the coding method switching signal S20, 
thus causing the intra-block predictive coding unit 2 
to execute the coding of the difference signal S2. 

When generating the coding method switching 
signal S20. the coding method switching judgment 
unit 3 generates a coding method switching signal 
representing the selected coding system, the 



switching signal thus generated being fed as the 
transmission management signal S7 to the variable 
length coding unit 6. 

The transmission data D 0 ut fed from the en- 

s coding system DV1 to the transmission system 8 in 
the above way, Is stored in a buffer circuit 31 of a 
decoding system DV2 shown in Rg. 2 for inverse 
coding in an inverse variable length coding unit 32. 
In this way, the decoded quantized signal S21 

?0 of the transmission data D 0 ut is fed through a 
delay circuit 33 for inverse quantizing in the inverse 
quantizer 34 and then fed to an inverse discrete 
cosine transform circuit 35 to reproduce the dif- 
ference signal S22, which is fed through an inverse 

is discrete cosine transform input terminal "a" of a 
switch 40 to a summation reproduction circuit 41. 

The decoded quantized signal S21 is also fed 
through a differentiator input terminal "c" of switch 
circuits 42A and 42B to an inverse differentiator 36 

20 for inverse differentiation and then fed to an inverse 
scan converter 37, or it is fed as such through 
bypass input terminals "d" of switch circuits 42A 
and 42B to the inverse scan converter 37. The 
decoded quantized signal S21 is thus restored in 

25 the inverse scan converter 37 to the original scan 
order and then inversely converted through an in- 
verse quantizer 38 and an inverse intra-block pre- 
dictor 39, thus obtaining a reproduced difference 
signal S23 which is fed through an intra-block 

30 predictive coding Input terminal w b" of a switch 40 
to the summation reproduction circuit 41. 

To the switch 40 is fed a coding method 
switching signal S24 in the management signal 
separated in the inverse variable length coding unit 

35 32. Thus, the switch 40 is switched to the side of 
the input terminal "a" or "b" according to the 
coding method of the transmitted decoded quan- 
tized signal S21 . 

The summing reproduction circuit 41 sums a 

40 difference signals S22 or S23 obtained from switch 
40 and a predicting signal S24 obtained from pre- 
dictor 43, and the summing output is derived as a 
restored data Dqutx- 

The predictor 43 receives a motion vector, 

46 predicting mode signal S25 in the management 
signal separated in the inverse variable length cod- 
ing unit 32 from the decoded quantized signal S21 
and restores the immediately preceding picture 
frame data sent during preceding transmission cy- 

50 cle based on the restored data Dqutx and feeds 
this data as the predicting signal S24 to the sum- 
mation reproduction circuit 41. In this way, the 
restored data Dqutx representing the picture frame 
data being transmitting at present is obtained 

55 based on the difference signal S22 or S23 being 
transmitting at present. 

The encoding unit DV1 (Rg. 1 ) and the decod- 
ing unit DV2 (Rg. 2) comprise the following de- 
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tailed constructions. 

(2) Discrete Cosine Transform Coding Unit 1 

The discrete cosine transform circuit 11 in the 
discrete cosine transform coding unit 1 in the en- 
coding system DV1 (Rg. 1), executes a compres- 
sion processing when changes in the inputted dif- 
ference signal S2 (and hence brightness changes) 
are smooth, by making use of a well-known feature 
of the two-dimensional picture of the discrete co- 
sine transform method that there is a trend of 
concentration of large values as values of the dis- 
crete cosine transform signal S3 (i.e., DCT coeffi- 
cient values) in the neighborhood of DC coefficient. 

Rg. 3 shows an example of schematic repre- 
sentation of pixel data quantity of one block (8 by 8 
pixels) of picture in terms of numerical figures of 0 
to 100. K1 is a block of the original picture. As 
shown, the brightness level is changed smoothly 
from the left top corner toward the right bottom 
corner. Each pixel has a brightness level of 30 to 
100. 

When this original picture K1 is subjected to a 
discrete cosine transform (DCT) process in the 
discrete cosine transform circuit 11, substantially 
all the intra-block coefficients are reduced to 0 in 
the discrete cosine transform signal S3. The result 
is shown as a transformed picture K2. DCT coeffi- 
cients having values other than 0 are present on 
the diagonal from the left top corner to the right 
bottom comer. 

When the DCT coefficients of the transformed 
picture K2 are subsequently quantized in the first 
quantizer 12 with a quantizing width Q of Q = 10, 
for instance, which is provided from the buffer 7 
with respect to the residual data quantity therein, 
almost all the quantized DCT coefficients in the 
quantized signal S4 are reduced to 0. and only 
large quantized DCT coefficients remain. This re- 
sult is shown as a quantized picture K3. Thus, by 
calling out the quantized DCT coefficients of the 
quantized picture K3 successively according to a 
coefficient call-out sequence K4 (numerical figures 
representing orders of call-out), a quantized DCT 
coefficient series "45-0-0-4-1 3-4-0-0-.,. w is ob- 
tained. By feeding this series through the delay 
circuit 13 and first selector 4A to the variable 
length coding (VLC) unit 6, a higher performance 
coding process can be obtained using a variable 
length coding method based on Huffman coding or 
the like (two-dimensional coding in this embodi- 
ment).* 

The coefficient call-out series K4 in the case of 
Rg. 3, the coefficient call-out orders are arranged 
in an obliquely zigzag fashion from the left top start 
point toward the right bottom from the consider- 
ation of the existence of a two-dimensional correla- 



tion of pixels. Rg. 4 shows a coefficient call-out 
series K5, which may be used for patterns having a 
horizontally strong correlation of coefficients. In this 
case, the coefficients are sequentially called out 
s from the top row (0 1o 7) of the block and in a 
vertically zigzag fashion (8 to 15), (16 to 23) 

(3) Intra-Block Predictive Coding Unit 2 

to In the intra-block predictive coding unit 2. when 

one block (8 by 8 pixels) of picture data, which 
contains an edge of a pattern at the left bottom 
corner, shown as original picture K1 1 (Rg. 5(A)), is 
fed as difference signal S2, the intra-block predic- 

75 tor 21 first obtains the mean value of flat area as a 
typical value "BASE" of block and then obtains the 
difference between the typical value BASE and 
each intra-blockpixel value. 

In the case of the original picture K1 1 in Fig. 5, 

20 the intra-block predictor 21 obtains BASE = 198 
as the typical value BASE, then obtains predictive 
picture K12 (Rg. 5(B)) by calculating the difference 
between the typical value BASE and each pixel 
value and feeds the data K12 as a predictive cod- 

25 ing signal S10 to the quantizer 22. 

The quantizer 22 quantizes the difference val- 
ues of the predictive coding signal SlO with an 
adaptive quantizing width Q of, for instance, Q = 
12 to obtain a quantizing coefficient distribution 

ao K13 (in Rg. 5(C)). In this embodiment, in the cal- 
culation of quantizing decimal fractions are dis- 
carded (which is equivalent to a quantizer having a 
dead line zone with a value of 6). 

For the adaptive quantizing in the intra-btock 

35 predictive coding (NTC) unit 2, one or more of the 
following four methods are selectively used for 
each block. 

A first method of adaptive quantizing uses the 
mean value of picture signal in the block. 
4o More specifically, as shown En Fig. 6, the mean 

value M of the amplitudes (XI to X2) of all the 
intra-block pixels of one-dimensional digital original 
signal SG is obtained for one block length T B i with 
respect to time t, and then the difference between 
45 the mean value M and signal level (i.e., amplitude 
X) of each pixel is quantized, as shown in Fig. 7. 
The quantizing width Q is a value output from the 
buffer 7 according to the residual data quantity 
therein. The quantizing code Lq is given as follow- 
so ing: 

L q * (L - M}//Q (1) 

(where // represents the rounding of the first deci- 
55 mal place). 

The restored value LX is given as following: 

LX = Lq-Q + M (2) 
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This first adaptive quantizing method as a dis- 
advantage that with increase of the quantizing 
width Q the restored value distortion is increased. 
As a r8suit, discontinuity UC is generated in 
changes in the restored value LX with respect to 
the original signal SG for each block, thus generat- 
ing block distortion. 

A second method of adaptive quantizing uses 
adaptive dynamic range coding (ADRC). 

This method is shown in "Study on Quantizing 
Systems for Dynamic Range Coding", Kondo et al, 
the Fourth Picture Coding Symposium (PCS J), Ma- 
terial (4-3). 

This adaptive dynamic range coding (ADRC) 
has a feature that a minimum value of block is 
used as a typical value. This is done so because 
the minimum value is in many cases found in an 
edge port of the block. 

With the usual block, which is as small area as 
about 3 by 8 pixels, the possibility of occurrence of 
a concave brightness level distribution is very low. 
Therefore, in many cases the minimum value of a 
block is close to the minimum value of one of the 
neighboring blocks. 

If a minimum value is found at an edge of the 
block, as shown in Fig. 9, the continuity with re- 
spect to at least one neighboring block (on the 
block length start side in this case). Thus, even if 
discontinuity UC is produced with respect to a 
neighboring block due to deviation between the 
original signal SG and restored value LX, the block 
distortion as a whole can be minimized. 

Further, the adaptive dynamic range coding 
method permits the quantizing code Lq to be ob- 
tained after defining new maximum value MAXX 
and minimum value MINX by using the mean value 
of signal- values contained in the highest and lowest 
gradation levels, as shown as a one-dimensionaJ 
coding characteristic in Fig. 10, thus alleviating the 
influence of noise and isolated points (as shown in 
Japanese Patent Application Public Disclosure 
134910/1990). 

A third method of adaptive quantizing uses 
edge matching quantizing. 

This method will be described in conjunction 
with first a case, in which the digital original signal 
SG is one-dimensional. 

In the third adaptive quantizing method, the 
quantizing width output from the buffer 7 is altered 
such that with respect to the one-dimensional origi- 
nal signal SG of a block length T BL as shown in 
Figs. 11 and 12 the output restored values LX1 and 
LX2 of the opposite end signal values X1 and X2 
(X1 3 X2 for the sake of the simplicity) of the block 
are less than a predetermined error Ex. The al- 
gorithm involved is as follows. 



Denoting the intra-block pixel signal level by L 
and the permissible restored value error of the 
block end signal values XI and X2 by Ex, the 
difference D between the block end signal values 
5 X1 and X2 is 

D » X2 - X1 (3) 

As for the quantizing width Q and signal value X1 , 
10 if 

D > Q (4) 

and also if 

75 

ABS(D - Q) > Ex (5) 

the quantizing width Q instructed by the buffer 7 is 
changed to a quantizing width q instructed to the 
20 quantizer 22 from the intra-biock predictor 21 , while 
the signal value X1 is held without any change. 

However, for the quantizing width q values 
greater than the quantizing width q and satisfying 

26 Ex £ ABS(D - (D//q)*q (6) 

are obtained with respect to all the sets of quan- 
tizing width Q and difference D and written as table 
in a read-only memory (ROM). 

30 If 

D > Q (7) 
and also if 

35 

Ex £ ABS(D - Q) (8) 

both the quantizing width Q and signal value X1 
are held without any change. 

40 If 

D5Q (9) 

the quantizing width Q is held without any change. 
46 while providing 

Xm = (X1 + X2)//2 (10) 

and 

50 

X1 = Xm (11) 

Consequently, we obtain, as the quantizing 
code U,, 

55 

* (L - X1 )//Q (12) 
and, as the restored value LX, 
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LX = Lq»Q + X1 (13) 

In this system, the error of the restored signal 
at the opposite ends of the block can be held 
within Ex, and thus it is possible to readily maintain 
enhanced inter-block continuity. 

While the above description has concerned 
with the case of applying the third adaptive quan- 
tizing method to the one-dimensional digital original 
signal SG, in case of expanding this one-dimen- 
sional method to two-dimensional blocks, typical 
values BASE1 and BASE2 are used for the respec- 
tive signal values X1 and X2, and the block signal 
is quantized and inversely quantized like the one- 
dimensional case. 

While the above description has concerned 
with a quantizer without any dead zone (or insensi- 
tive zone), it is possible to use a quantizer with a 
dead zone as well. 

A fourth method of adaptive quantizing uses 
second edge matching quantization. 

The method will first be described in conjunc- 
tion with a case, in which the digital original signal 
SG is one-dimensional. 

In this method, the decoded values are 
changed on the decoder side such that the signal 
values XI and X2 (X1 S X2 for the sake of the 
simplicity) with respect to the one-dimensional 
original signal SG of a block length T BL as shown in 
Fig. 13 are output directly, as decoded values- 
Denoting the intra-block pixel signal level by X and 
the quantizing width data output from the buffer 7 
by Q, the quantization code is 

U, = (L-X1)//Q (14) 

The encoding system DV1 (Fig. 1) transmits, in 
addition to the quantizing code Lq, the signal value 
X1, the difference D between the signal values X1 
and X2 and the quantization width Q to the decod- 
ing system DV2. In the decoding system DV2, the 
signal values X1 and X2 and quantizing width Q 
are received as quantizing parameters, and a quan- 
tized value 2q of the signal value X2 is first cal- 
culated using an equation; 

X2q = (X2-X1)//Q (15) 

Then the restored value LX is restored as 

LX = LX2 (16) 

if the quantizing code Lq is equal to X2g, and 
otherwise as 

LX = L^Q + X1 (17) 



The second edge matching quantizing method 
is simple in algorithm compared to the previous 
first edge matching coding method and permits 
simplification of the constitution in that no ROM 
s table for changing the quantizing width Q is need- 
ed. 

When expanding this second edge matching 
quantizing method to two-dimensional block signal, 
typical values BASE and BASE' are used as the 

10 respective signal values X1 and X2 for quantizing 
and inverse quantizing of the block signal as in the 
case of one-dimensional block signal. 

While the above description has concerned 
with a quantizer without dead zone (or insensitive 

is zone), it is possible to use a quantizer with a dead 
zone as well. 

The functions of the quantizer and inverse 
quantizer described in connection with the above 
first to fourth adaptive quantizing methods are the 

zo same as those broadly used in the discrete cosine 
transform (OCT) coding except for the execution of 
the subtraction or addition of a typical value of 
block. Thus, it is possible to permit the quantizer 
and inverse quantizer to be used commonly in the 

25 intra-block predictive coding (NTC) unit 2 and dis- 
crete cosine transform (DCT) coding unit 1 by 
making the processing of subtraction or addition of 
the typical value of block independent from the 
quantizer and inverse quantizer. 

30 Subsequently, the scan converter 23 (Fig. 1) 

executes adaptive coefficient call-out according to 
a quantized coefficient distribution K13 (in Fig. 5- 
(C)) represented by the quantized signal S11. in 
this embodiment, the quantized coefficients in the 

35 quantized coefficient fashion as represented by a 
coefficient call-out sequence K14 (in Fig. 5(C)). In 
this way, the rearranged quantized signal S12 pro- 
duced as a result of rearrangement of the individual 
quantized coefficients is output from the scan con- 

40 verter 23. 

The block signal after the quantization, fed to 
the scan converter 23 of the intra-block predictive 
coding (NTC) unit 2, is rearranged by scan conver- 
sion back to the one-dimensional arrangement. The 

^6 block signal after the quantizing is transmitted by 
an end-or-block (EOB) method. In this method, the 
scan converted signals are scanned in their se- 
quence, and if there is a continuation of coefficients 
of "0" up to the last coefficient this continuation of 

so "0"s is transmitted as a sole code "EOB" (which 
see Fig. 5(E)). 

Thus, by selecting a data scan path, which 
permits transmission of the code "EOB", in as 
early timing as possible, high compression factor 

55 data coding can be obtained. 

In this embodiment four different data scan 
paths DSP1 to DSP4 shown in Figs. 14(A) to 14(D) 
are prepared. 
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One of these first to fourth data scan paths 
DSP1 to DSP4 is adaptively selected according to 
the intra- block edge shape. 

Fig. 15 shows the accurate definition of the 
algorithm in C language. The summation of the 
absolute values of the -block signal after the quan- 
tizing in each of lour areas "PIXEL AREA1 

n PIXEL AREA2", "PIXEL__ AREA3" and 

"PIXEL^AREA-T shown in Rg. 15(A) Is calculated, 
and the area having the greatest summation is 
detected. The data scan path is selected according 
to the result of detection. 

Finally, the differentiator 24 differentiates the 
rearranged data, having been fed to it through the 
( switch 27A (Fig. 1), consecutively from the start of 
the data and between adjacent data to obtain a 
differentiated distribution K15 (in Fig. 5(D)). In the 
differentiator 24, as shown in Rg. 16, a delay line 
24A delays the rearranged quantized signal S12 by 
one process period, and a subtracter 24B subtracts 
the delayed signal from the rearranged quantized 
signal S12 form a differentiated distribution K15, 
the subtraction output being transmitted as a dif- 
ferentiated output S13. 

There are cases when there still remain much 
self correlation of signal in the coefficients after the 
scan conversion. Thus, further data compression is 
possible by subsequently executing a differentiat- 
ing process. The differentiator 24 takes the dif- 
ference of pixel value with respect to the value of 
the immediately preceding pixel for signal Yi ob- 
tained after the scan conversion in the scan con- 
verter 23, thus obtaining a predictive error signal Ei 
given as 

Ei = Yi - Y(i - 1) (18) 

This predictive error signal Ei can take a value 
of -255 to +255 if the input signal is of 8 bits. 
Thus, if it is to be transmitted without changing its 
signal form, 9 bits are required, that is, one extra 
bit is necessary as a code perpixel. However, it is 
well known that the predictive error signal Ei is 
mostly concentrated around zero as its center. 
Thus, instead of expressing all the signals with 9 
bits, by assigning small bit length codes to a large 
number of signal values the block signal of the 
whole block can be expressed with a mean bit 
length, which is not only smaller than 9 bits but 
also far smaller than the original 8-bit input signal. 

As a method of on -off switching the differen- 
tiator 24, if the number of signals other than zero is 
found to be reduced as a result of actual differen- 
tiating processing, the differentiator 24 is turned on, 
that is, the switches 27A and 27B are switched to 
the side of the differentiator 24. Otherwise, the 
switches 27A and 27B are switched to the bypass 
side. 



The coded differential data which is thus ob- 
tained in the intra-block predictive coding unit 2 is 
coded in the variable length coding (VLC) unit 6 by 
Huffman variable length coding (in this embodiment 

5 by the two-dimensional coding as noted above) to 
form Huffman code series K16 (In Rg. 5(E)). In this 
way, high efficiency coding can obtained. 

The transmitted data Dour obtained in the cod- 
ing system DV1, having been transmitted on the 

io basts of the Huffman code series K16 (in Rg. 5) to 
the decoding system DV2, is inversely converted 
through the inverse variable length coding unit 32, 
inverse differentiator 36, inverse scan converter 37 
and inverse quantizer 38 to obtain an inversely 

75 quantized coefficient distribution K18 (in Fig. 5(F)) 
and then restored to a restored picture K19 (in Fig. 
5(G)). With addition of typical value BASE1 through 
the predictor 43 and adder 41 . 

In case when the differentiator 24 (Rg. 1) is 

20 unnecessary, the switches 27A and 27B are 
switched to the side of the bypass output terminal 
"d w to lead the rearranged quantized signal S12 
along the bypass. In this case, as shown in Fig. 17 
in correspondence to Fig. 5, a predicted picture 

25 K12 (in Fig. 17(B)) and a quantized coefficient 
distribution K13 (in Rg. 17(C)) are obtained con- 
secutively based on the original picture K1 1 (in Rg. 
17(A)), and then by calling out coefficients in a 
coefficient call-out sequence K14 (in Fig. 17(C)), a 

30 coefficient distribution K17 (in Rg. 17(D)), which is 
obtained by merely rearranging the quantized co- 
efficient values of the quantized coefficient distribu- 
tion K13, is fed to the variable length coder 6, thus 
obtaining a Huffman code series K16 (in Rg. 17(E)- 

35 ). 

Again in this case, an inversely quantized co- 
efficient distribution K20 (in Fig. 17(F)) and a re- 
stored picture K21 (in Fig. 17(G)) are restored in 
the decoding system DV2. 

AO 

(4) Coding Method Switching Judgment Unit 3 

The coding method switching judgment unit 3 
(Rg. 1) judges that coding of a motion picture 

45 signal for each block unit is to be performed by 
which a discrete cosine transform coding (DCT) or 
an intra-block predictive coding (NTC). 

The coding method switching judgment unit 3 
judges any coding method having to be selected, 

so based on a spatial area or a discrete cosine trans- 
form (DCT) output area being within the intra-block 
picture information. 

First coding method switching judgment is ef- 
fected in the picture block space area. With a 

55 pattern having sharp brightness changes 
(specifically a picture including edge portions or 
detailed portions), the dynamic range DR (DR = 
maximum value - minimum value) of intra-bfock 



17 



EP 0 549 813 A1 



18 



picture signal takes a large value. With such a 
pattern the discrete cosine transform (DCT) is dis- 
advantageous for the data compression factor. That 
is, the intra-biock predictive coding (NTC) has to 
be selected. In this case, the coding method 
switching judgment -unit 3 derives the intra-block 
dynamic range DR from each block, and then for a 
block with a value of DR exceeding an appropriate 
threshold value THA selected based on the com- 
pression factor and pattern deterioration, the unit 3 
judges that the intra-block predictive coding (NTC) 
unit 2 should be used for the coding. 

In a second method of coding method switch- 
ing judgment, the judgment is effected in the dis- 
crete cosine transform (DCT) output area. As for 
the discrete cosine transform coefficients in case 
when motion picture signal is subjected to two- 
dimensional discrete cosine transform in blocks (or 
macro-blocks) each of 8 by 8 pixels, for instance, 
coefficient F(0,0) in row 0 and column 0, cor- 
responding to the left top comer of the block, 
corresponds to a DC component representing the 
intra-biock mean brightness of the picture. As one 
goes to the right from the coefficient F(0,0), the 
coefficients represent high frequency components 
of vertical fringes in the block, and as one goes 
down, the coefficients represent horizontal fringe 
high frequency components. 

Fig. 18 shows an output obtained as a result of 
the discrete cosine transform of a block having a 
sharply changing brightness, pattern like an edge 
portion. Output areas of discrete cosine transform 
coefficients in the 8-by-8 pixel block can be largely 
classified into the following three different pattern 
cases. In Fig. 18, the "circle" mark represents a 
position of a high (or low) brightness pixel, and the 
"cross'* mark represents a position, at which a 
large intra-block discrete cosine transform coeffi- 
cient is liable to be generated. 

A first pattern, as shown in Fig. 18(A), is in a 
case of a block picture area K31 having a vertical 
edge. In this case, the discrete cosine transform 
output area K32 has high energy discrete cosine 
transform (DCT) coefficients concentrated in an 
area like a horizontal line extending from the first 
coefficient position. This case is referred to as 
"case r. 

A second pattern, as shown in Fig. 18(B), is in 
a case of a block picture area K41 having a hori- 
zontal edge. In this case, the discrete cosine trans- 
form output area K42 has high energy discrete 
cosine transform coefficients concentrated in an 
area like a vertical line extending from the first 
coefficient position. This case is referred to as 
"case 2". 

A third pattern, as shown in Fig. 18(C), is in a 
block picture area K51A or K51B having an ob- 
liqued edge. In this case, the discrete cosine trans- 



form output area K52 has high energy discrete 
cosine transform coefficients concentrated in an 
area like an oblique line extending from the first 
coefficient position. This case is referred to as 

s "case 3". 

The coding method switching judgment unit 3 
obtains, for the cases in Figs. 18(A) to 18(C), the 
summation Fa of the absolute values of ail the 
discrete cosine transform coefficients except the 

10 DC component and also the summations F1 to F3 
of the absolute values of the discrete cosine trans- 
form coefficients indicated by the "cross" marks in 
the discrete cosine transform output areas K32, 
K42 and K52 of the cases 1 to 3 for each block, 

is and using the largest one Fmax of the absolute 
value summations F1 to F3, it judges that the intra- 
block predictive coding unit 2 should be used for 
coding a block, in which the ratio of the largest 
absolute value summation Fmax to the absolute 

20 value summation Fa exceeds an appropriate 
threshold value THB selected from the consider- 
ations of the compression factor and pattern dete- 
rioration. 

In a third method of coding method switching 

25 judgment, the judgment is effected in both of the 
discrete cosine transform output area and picture 
block space area. In this case, the coding method 
switching judgment unit 3 determines the coding 
method to be used by executing a coding method 

30 selection routine RT1 shown in Fig. 19. 

in the coding method selection routine RT1 
shown in Fig. 19, in a step SP1 the coding method 
switching judgment unit 3 checks the output as a 
result of the discrete cosine transform of the input 

35 picture block according to the discrete cosine 
transform signal S3 of the discrete cosine trans- 
form circuit 11, and in a step SP2 it checks wheth- 
er the discrete cosine transform output area block 
has transform coefficients representing a sharply 

40 changing brightness pattern like an edge (i.e., both 
of small low and large high frequency coefficients). 

This check is done for utilizing, for the coding 
method switching, a character of the sharply 
changing brightness pattern that broadly distributed 

46 frequency components from low to high frequen- 
cies are generated in the discrete cosine transform 
output area. At this time, the coding method 
switching judgment unit 3 executes an algorithm 
shown in Figs. 21 and 22. 

50 Denoting the summation of the second powers 

of 17 low frequency area coefficients exclusive of 
the left top corner DC component, as shown in Fig. 

21(A), by "low ac power" and the summation of 

the second powers of all the discrete cosine trans- 

55 form coefficients except the DC component by 

"all ac power", if "low ac power" is no greater 

than a threshold "LITTLE__AC THRESHOLD" and 
also if the ratio between "low ac power" and 
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"all ac power" is no less than a threshold value 

"AC CONCENTRATE THRESHOLD", it is 

judged that the discrete cosine transform system 
should be used for coding this input picture block. 
At this time, a NO result is yielded in the step SP2 
in Fig. 19, and the discrete cosine transform coding 
unit 1 for the execution of the coding. 

Otherwise, the pertinent block is determined to 
be a candidate block for the intra-block predictive 
coding (NTC). At this time, the coding system 
judging unit 3 obtains a YES result in the step SP2 
in Fig. 19, and thus it executes the next step SP3. 

The threshold values 

"LITTLE AC THRESHOLD" and "AC_ 

CONCENTRATE THRESHOLD" and the low fre- 
quency region may be set adequately from the 
considerations of the compression factor and pat- 
tern deterioration. 

The coding method switching judgment unit 3 
executes in the step SP3 an edge block detection 
sub- routine RT2 shown in Fig. 20 to detect a block 
including an edge, and then in the next step SP4 it 
judges whether the detected block includes edge 
picture. 

In the edge block detection sub-routine RT2 
shown in Fig. 20, in a step SP11 the coding meth- 
od switching judgment unit 3 calculates the typical 
values "BASE1 " and "BASE2" of the block. 

The typical values "BASE1" and "BASE2" of 
the block are mean values of flat area in the 
pertinent block. 

It is assumed that pixel values of a block 
consisting of 8 by 8 pixels are stored in array 
memory pixel positions x[ ] in the order of numbers 
shown in Fig. 22(A). The typical values of the block 
are estimated from 28 pixels shown in Fig. 22(B). 
These pixel values are taken out from the positions 
x[ ] in the order shown by arrow in Fig. 22(C) 
(numbers indicating the order) and stored in an 
array memories t[ ] as shown in Fig. 23(A). 

The typical values of the block are calculated 
with a DCT/NTC judging algorithm shown in Figs. 
24 to 28. Rgs. 24 to 28 shown the accurate defini- 
tion of the algorithm in C language. 

First, a differentiating process is executed be- 
tween adjacent samples on the array memories t| ] 
to obtain differential value data of the array mem- 
ory t[ ], and flat area estimation is effected accord- 
ing to this data. The flattest area is defined to be 
one, in which the summation of the absolute values 
of 8 continuous differential values of the array 
memories t[ ] is smallest. A typical value of the 
block is defined to be the mean value of the values 
in 8 array memories t[ ] in the flattest area. This 
value is referred to as "BASE1", and the summa- 
tion of the absolute values of the differential values 
in array memories t[ J in this area is referred to as 
"sum absdiffl". 



In steps SP12 and SP13, the coding method 
switching judgment unit 3 judges whether the per- 
tinent block has at least one of the following states, 
if the block has at least one such state, it is 
5 discrete cosine transform coded. 

(a) peak < PEAK THRESHOLD 

Peak is the value as shown in Fig. 29, and 
its accurate definition is shown in Ftg. 26. 

The PEAK THRESHOLD is a threshold val- 

10 ue given by the coder. 

(b) BASE1 being ineffective 

More specifically, sum abs diffl > 

FLAT SAD THRESHOLD is a threshold value 

given by the coder. 

is Subsequently, the coding method switching 

judgment unit 3 executes a step SP14 in Fig. 20 
to search the other typical value BASE2 of the 
block in a method shown in Fig. 25. The typical 
value n BASE2 n is searched in an area on the 

20 opposite side of the area, in which the typical 
value BASE1 is detected (see in Ftg. 23(B)). The 
typical value BASE2 is calculated in the same 
manner as for the typical value BASEL The 
typical value BASE2 need not be present. If the 

26 block has at least one of the following states, the 
typical value BASE2 is invalid and not present. 

(c) surn__abs__diff2 > 
FLAT_SAD THRESHOLD 

(d) [BASE2_BASE1| < 
30 DIFF BASE THRESHOLD 

The symbol "j j" here indicates the absolute 
value calculation. 
DIFF BASE THRESHOLD is s threshold val- 
ue given by the coder. 

35 In subsequent steps SP15 and SP16 in Fig. 20, 

the coding method switching judgment unit 3 
checks the size of the flat area. 

In this routine, unit 3 checks whether the flat 
area in the pertinent block is large or not. Rgs. 27 

40 and 28 show the accurate definition of the al- 
gorithm in C language. 

First the absolute value "diff^basel " of dif- 
ference signal between each pixel value (x) in the 
block and BASE1 is calculated. 

46 Then, the number of pixels, in which 

diff basel is no greater than threshold value 

w DIFF__BASE_THRESHOLD w , is calculated to ob- 
tain "count basel pixel". If the typical value 

BASE2 is present, the same calculation is done 

so with respect to the typical value BASE2 to obtain 

"count base2 pixel " . If the sum of 

count basel pixel and count base2 pixel is 

not greater than threshold value 
"COUNT FLAT__P1XEL THRESHOLD", a YES 

55 result yields in a step SP16. In this case, the 
coding method switching judgment unit 3 thus se- 
lects the discrete cosine transform system for cod- 
ing this block. 

12 
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If a NO result yields in the step SP16, on the 
other hand, in a step SP17 the coding method 
switching judgment unit 3 ends the pertinent edge 
block detection sub-routine RT2 and returns to the 
coding system selection routine RT1 in Fig. 19. 

At this time, the coding method switching Judg- 
ment unit 3 executes the steps SP4 through SP7 to 
select the intra-block predictive coding (NIC) sys- 
tem for coding. 

When the irrtra-block predictive coding (NTC) 
system is thus selected for coding, if 

count basel pixel and count base2 __pixei, the 

typical values BASE1 and BASE2 are interchan- 
ged. 

Meanwhile, H the block (i.e., macro-block) to be 
coded is an intra-frame signal coded macro-block, 
the typical value BASE1 is transmitted as intra- 
block predictive value (corresponding to the DC 
value in the discrete cosine transform (DCT) cod- 
ing. 

If the macro-block to be coded is an inter- 
frame signal coded (or non-intra-frame coded} 
macro-block, the typical value BASE1 is fixed to 
zero and not transmitted. Alternatively, it is possi- 
ble to transmit the typical value BASE1 even if the 
macro-block to be coded is a non-intra-frame cod- 
ed macro-block. Thus, if the absolute value of the 
typical value BASE1 is greater than the threshold 

value "DIFF BASE THRESHOLD", the discrete 

cosine transform (DCT) coding is selected for cod- 
ing the block. 

Threshold values BASE DISTANCE ERR, 

DIFF BASE THRESHOLD. 

FLAT__SAD THRESHOLD, PEAK THRESHOLD, 

BASE__ DISTANCE THRESHOLD and 

COUNT FLAT PIXEL__THRESHOLD are ade- 
quately set in dependence on the compression 
factor and pattern deterioration. 

In the calculation of the typical values of block, 
the typical value "BASE1 " obtained in the series of 
edge block detection processes executed in the 
step SP3, for instance, is adapted as typical value 
"BASE" of block. In addition, if the typical value 
"BASE2" is present, it is used as typical value 
"BASE'" of block. If the typical value "BASE2" is 
not present, as the typical value "BASE'" of block 
is used an intra-block sample value, which cor- 
responds to the greatest absolute value of the 
difference between the typical value and intra-block 
sample value. 

Instead of such method of calculation, it is 
possible to use the mean or smallest intra-block 
sample value as the typical value. 

(5) Variable Length Coding 

The variable length coding (VLC) unit 6 vari- 
able length codes the transmission management 



signal S7, which is constituted by discrete cosine 
transform (DCT) coding/intra-block predictive cod- 
ing (NTC) switching information, the typical value 
BASE of block used for intra-block predictive cod- 

s ing (NTC) and quantizing width Q (or the typical 
value of block, difference between the typical value 
BASE and the other typical value BASE* of block 
and quantizing value Q), the order of intra-block 
sample scanning and the switching information as 

to to whether the differentiating process is to be ex- 
ecuted, along with molion picture data to be trans- 
mitted in the following way. 

In the block-by- block discrete cosine transform 
(DCT) coding, a macro-block is formed with a plu- 

15 rality of coded blocks adjacent to one another as a 
group, and a single coding method is used for the 
transmission of the macro-block. 

Particularly, in this embodiment for the switch- 
ing of the method of intra-macro-block motion pic- 

20 ture data coding the switching information and ad- 
ditional information for the intra-block predictive 
coding (NTC) are added, as well be described 
below in detail. 

The following information ts used for the 

25 macro-block coding. 

First coding information is macro-block type 

(macroblock type). This information concerns 

whether contents of VLC coded representing the 
macro-block coding method include macro-block 

30 quantizing scale, information as to whether the 
macro-block is of the intra- or inter-frame coding 
mode, prediction mode in the inter- frame coding 
mode, macro-block motion predictive vector and 
intra-block predictive coding (NTC) of blocks con- 
as stituting a macro-block. 

Second coding information is macro-block 

quantizing scale (Quantize scale). With blocks 

constituting macro-blocks constituted by VLC 
codes representing macro-block quantizing scale 

40 values, this quantizing scale is basically used to 
quantize discrete cosine transform (DCT) coeffi- 
cients or picture signal. For blocks to be intra-bfock 
non-transform coded, it is possible to use a block 
quantizing scale to be described later. 

45 Third coding information is macro-block motion 

predictive vector (Motion vector). This information 

is a VLC code representing a motion predictive 
vector value in case when the macro- block is of the 
inter-frame coding mode. 

so Fourth coding information is a coded block 

pattern (Coded block pattern). This information 

is a VLC code representing the position of a block 
among blocks constituting a macro-block, in which 
has discrete cosine transform (DCT) coefficients or 

55 picture coefficients to be transmitted. It is not 
present when the macro-block is of the intra-frame 
coding mode. 
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Fifth coding information is DCT/NTC switching 
information. When the coding of block includes the 
intra-block predictive coding (NTC), the information 
consists of a VLC code representing the position of 
a block, for which NTC is selected. It is not present 
when the discrete cosine transform (DCT) coding is 
selected for all the blocks. 

Fig. 30 shows a case, in which each macro- 
block consists of 4 blocks. In this case, a macro- 
block of the intra-frame coding mcde is repre- 
sented by a 4-bii code, each bit representing cod- 
ing system switching information with respect to 
each block constituting the macro-block. 

Likewise, an intra-frame coding mode macro- 
block may be represented with a 4-bit code. Alter- 
natively, it may be represented with a code having 
a length equal to the number of blocks, in which 
coefficient judged from the "coded block pattern" 
noted above is presenting. 30). 

When each bit is "0", it represents the discrete 
cosine transform (DCT). When it is "1", it repre- 
sents the intra-block predictive coding (NTC). 

This information may be replaced with a Huff- 
man variable length code or the like. 

In Fig. 30, MB means a macro-block, which 
consists of 4 blocks. If the 0th macro-block MB 
No.O is of the intra-frame coding mode and also if 
the content of the block Y 00 is that "there is no 
coefficient of discrete cosine transform (DCT) cod- 
ing " the content of the block Y 0 i is that "there is 
coefficient of the intra-block, predictive coding 
(NTC)", the content of the block Y 02 is that "there 
is coefficient of intra-block predictive coding (NTC) 
and the content of the block Y031S that "there is 
coefficient of discrete cosine transform (DCT) cod- 
ing", the "discrete cosine transform (DCT) 
coding/intra-block predictive coding (NTC) switch- 
ing information" can be represented by 3-bit data 
"001 

Block coding information is as follows. 

First block coding information is additional in- 
formation for the intra-block predictive coding. This 
information is present in case of a block, in which 
the following three codes (a) to (c) are coded by 
the intra-block predictive coding (NTC). 

(a) Data scan path type 

This code represents the type of the selected 
data scan path. For example, when the four dif- 
ferent paths DSP1 to DSP4 as noted above in 
connection with Fig. 14 are prepared, the selected 
path can be represented by using a 2-bit code. 



(b) Rag as to whether differentiation is to be ex- 
ecuted 

This flag concerns whether a differentiating 
5 process is to be executed after the scan conver- 
sion. It is a one-bit on-off data. 

(c) Block Quantizing scale 

10 This code is a VLC code concerning the block 

quantizing scale value. It is unnecessary in case 
the block quantizing scale is fixed to the "macro- 
block quantizing scale" noted above or to a value 
obtained by substituting the "macro-block quan- 
ts tizing scale" into a certain equation. 

For example, it may be unnecessary with a 
motion picture coding system, in which the discrete 
cosine transform coding and intra-block predictive 
coding are adaptively switched for each block to be 
20 coded, while transmitting block discrete transform 
coding/intra-block predictive coding switching in- 
formation, and also in which for the intra-block 
predictive cod i ng two typical values BASE and 
BASE* of block are obtained to transmit BASE, 
25 difference between BASE and BASE' and quan- 
tizing width for adaptive quantizing. Otherwise, the 
value of the block quantizing scale may be repre- 
sented by a code of a fixed length, for instance 
about 7 bits. Alternatively, the difference of the 
30 scale from the "macro-block quantizing scale'* 
noted above may be expressed by variable length 
coding it. 

Second block coding information is an intra- 
block typical value and consists of a VLC code 

35 concerning therewith. This code is unnecessary in 
case when the intra-block typical value is fixed to 
"0". Otherwise, the intra-block typical value (which 
is a DC coefficient in case of the discrete cosine 
transform coding and BASE in case of the intra- 

40 block predictive coding) may be represented by a 
fixed length code of 8 bits, for instance. Alter- 
natively, it is possible to execute a differentiating 
process on block typical values in an order as 
shown by arrow in Fig. 31 and variable length code 

46 the oblained differentiated values. 

Third block coding information is the difference 
between two intra-block typical values. In a motion 
picture coding system, in which the discrete cosine 
transform coding and intra-block predictive coding 

so are adaptively switched for each block to be coded, 
while transmitting block discrete cosine transform 
intra-block predictive coding switching information, 
and also in which for the intra-block predictive 
coding the two typical values BASE and BASE' of 

55 block are obtained to transmit BASE, difference 
value between BASE and BASE* and quantizing 
width for adaptive quantizing, for the intra-block 
predictive coding the difference between the two 
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typicaJ values BASE and BASE' of block is trans- 
mitted with a fixed length of 8 bits, for instance. 

Fourth block coding information is coefficient 
data (picture data). This data is obtained by con- 
verting scan-converted one-dimensional data into 
VLC codes. It is transmitted by two-dimensional 
Huffman coding, for instance. In this case, for a 
coefficient having a value other than "0° this value 
and relative position of the coefficient are set to 
form a variable length code for transmission. 

The discrete cosine transform and intra-block 
predictive coded signals have different statistical 
characters. Accordingly, reference tables for two- 
dimensional Huffman coding may be prepared for 
both of the signals and used according to the 
discrete cosine transform coding/intra-block predic- 
tive coding switching signal. By so doing, the cod- 
ing efficiency can be further increased. 

(6) Decoding System 

In the decoding system DV2, as shown in Fig. 
2, the coded bit stream input is temporarily stored 
in the buffer 31 . Then, the inverse variable length 
coding (inverse VLC) unit 32 decodes the 
DCT/NTC switching signal from the stored coded 
bit stream and selects either DCT or NTC for each 
block according to the decoded information. 

The delay circuit 33 is provided for timing 
adjustment with respect to the NTC processing. 
The first inverse quantizer 34 and inverse discrete 
cosine transform (DCT) circuit 35 have comple- 
mentary structures to those of the corresponding 
elements in the discrete cosine coding unit 1 noted 
above. 

Likewise, the inverse differentiator 38 (which 
includes a one process period delay circuit 38A 
and an adder 38B as shown in Fig. 32), inverse 
scan converter 37, second inverse quantizer 38 
and inverse intra-block predictor 39 have com- 
plementary structure to those of the corresponding 
elements in the intra-block predictive coding unit 2. 

The predictor 5 restores original picture from 
the output of the inverse DCT circuit 35 or inverse 
intra-block predictor 39 that has been obtained by 
processing for each block. 

Industrial Applicability 

As has been described in the foregoing, the 
motion picture coding/decoding system according 
to the present invention permits sufficiently high 
data compression, and thus it can be suitably used 
for the transmission of motion picture signal 
through a transmitting system with limited data 
transfer speed such as television telephone sys- 
tems and video recording and reproducing sys- 
tems. 



References of Reference Numerals and Symbols 

1 ... discrete cosine transform coding (DCT) 
unit, 2 ... intra-block predictive coding (NTC) unit, 3 

s ... coding method judgment unit, 4A, 4B ... first and 
second selectors, 5 ... predictor, 6 ... variable 
length coding (VLC) unit, 7 ... buffer, 11 ... discrete 
cosine transform (DCT) circuit, 12 ... first quantizer, 
13 ... delay circuit, 14 .„ first Inverse quantizer, 15 

10 ... inverse discrete cosine transform unit, 21 ... 
intra-block predictor, 22 ... second quantizer, 23 ... 
scan converter, 24 ... differentiator, 25 ... second 
inverse quantizer, 26 ... inverse intra-block predic- 
tor, 31 ... buffer, 32 ... inverse variable length 

75 coding (VLC) unit, 33 ... delay circuit 34 ... first 
inverse quantizer, 35 ... inverse discrete cosine 
transform unit, 36 ... inverse differentiator , 37 ... 
inverse scan converter, 38 ... second inverse quan- 
tizer, 39 ... inverse intra-block predictor, 43 ... pre- 

zo dictor, DV1 ... encoding system, DV2 ... decoding 
system. 

Claims 

25 1. A motion picture encoding system for transmit- 
ting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 

a coding method is adaptively switched 

30 either to a discrete cosine transform coding 

method or to an intra-block predictive coding 
method for each block to be coded, discrete 
cosine transform coding/intra-block predictive 
coding switching information for each block 

35 being transmitted together with coded motion 

picture data, and when effecting the intra-block 
predictive coding a predictive value of a block 
and quantizing width information are transmit- 
ted for adaptive quantizing. 

40 

2. The motion picture encoding system for trans- 
mitting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 

46 a coding method is adaptively switched 

either to a discrete cosine transform coding 
method or to an intra-block predictive coding 
method for each block to be coded, discrete 
cosine transform coding/intra-block predictive 

so coding switching information for each block 

being transmitted together with coded motion 
picture data, and when effecting the intra-block 
predictive coding a predictive value of a block 
and dynamic range information are transmitted 

55 for adaptive quantizing. 

3. The motion picture encoding system of claims 
1 or 2, wherein; 
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coding information is subjected to differen- 
tial pulse coding modification (DCPM). 

A motion picture decoding system for decod- 
ing a bit stream of coded motion picture data, 5 
wherein: 

decoded blocks obtained as a result of 
inverse discrete cosine transform and decoded 
blocks obtained as a result of inverse intra- 
block predictive coding are selected according 10 
to received discrete cosine transform 
coding/intra-block predictive coding switching 
information, and a motion picture is decoded 
from the selected blocks. 

15 

The motion picture encoding system for trans- 
mitting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 

a coding method is adaptive! y switched 20 
either to a discrete cosine transform coding 
method or to an intra- block predictive coding 
method for each block to be coded, discrete 
cosine transform coding/intra-block predictive 
coding switching information for each block 25 
being transmitted together with coded motion 
picture data, and when effecting the intra-block 
predictive coding a typical value of block and 
quantizing width information are transmitted for 
adaptive quantizing. 30 

A motion picture encoding system for transmit- 
ting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 35 

a coding method is adaptive iy switched 
either to a discrete cosine transform coding 
method or to an intra-block predictive coding 
system for each block to be coded, simulta- 
neously discrete cosine transform coding/intra- 40 
block predictive coding switching information 
for each biock is transmitted together with cod- 
ed motion picture data, and when effecting the 
intra-block predictive coding a first and a sec- 
ond typical value of block are obtained, said 4s 
first typical value, the difference between said 
first and second typical values and quantizing 
width information are transmitted for adaptive 
quantizing. 

50 

The motion picture encoding system of claims 
5 and 6, wherein: 

quantized data is converted to onenjimen- 
sional data by adaptive scanning according to 
its distribution in a block, and said one-dimen- 55 
sional data is subjected, if necessary, to a 
differential coding process between adjacent 
samples to obtain difference value data, scan- 



ning order information and switching informa- 
tion as to whether or not the differential coding 
process is to be executed, are transmitted 
together with coded motion picture data. 

8. The motion picture encoding system for trans- 
mitting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 

a coding method is adaptive! y switched 
either to a discrete cosine transform coding 
method or to an intra-block predictive coding 
method for each block to be coded, discrete 
cosine transform coding/intra-block predictive 
coding switching information for each block 
being transmitted together with coded motion 
picture data, and when effecting the intra-block 
predictive coding a typical value of a block and 
quantizing width information are transmitted for 
adaptive quantizing; and 

quantized data is converted to one-dimen- 
sional data by adaptive scanning according to 
its distribution in a block, said one-dimensional 
data is subjected, if necessary, to a differential 
coding between adjacent samples to obtain 
difference value data, scanning order informa- 
tion and switching information as to whether or 
not the differential coding process is to be 
executed are transmitted together with coded 
motion picture data, and typical values of block 
used for discrete cosine transform coding/intra- 
block predictive coding are subjected together 
with intra-block sample quantizing width, scan- 
ning order and switching information as to 
whether or not the differential coding process, 
has been executed to variable length coding. 

9. A motion picture encoding system for transmit- 
ting motion picture signal after compression 
thereof through intra- and inter-picture coding 
processes, wherein: 

a coding method is adaptively switched 
either to a discrete cosine transform coding 
method or to an intra-block predictive coding 
system for each block to be coded, simulta- 
neously discrete cosine transform coding/intra- 
block predictive coding switching information 
for each block is transmitted together with cod- 
ed motion picture data, and when effecting the 
intra-block predictive coding a first and a sec- 
ond typical value of a block are obtained, said 
first typical value, the difference between said 
first and second typical values and quantizing 
width information are transmitted for adaptive 
quantizing; 

quantized data is converted to one-dimen- 
sional data by adaptive scanning according to 
its distribution in a block, and said one-dime n- 
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si o rial data is subjected, if necessary, to a 
differential coding process between adjacent 
samples to obtain difference value data, scan- 
ning order information and switching informa- 
tion as to whether or not the differential coding 5 
process Is to be executed, are transmitted 
together with coded motion picture data; and 

discrete cosine transform coding/intra- 
block predictive coding switching information, 
said first typical value of block used lor the to 
intra-biock predictive coding, the difference of 
said first typical value and said second typical 
value as another typical value of the block, 
intra-biock sample quantizing width, scanning 
order and switching information as to whether 75 
a differential coding process is to be executed 
are subjected to variable length coding . 
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DATA SCAB PATH selector calculates the following variables. 

Variable sunL-abs-5vent [0 ] is the sumaation of absolute quantized pixels in PIXES_AR£A1. 
And suia.abs_event[l]suB-abs.event[2], and su«^abs_event[33 are the sMuaation of absolute 
quantized pixels in PIXELARBA2. PIXELAREA3. and PIXELAREA4 respectively. 



nx=Q; 

for(n=Q;n<4:nTr) 
if (smuabs-event u]>oax) 
nax=suiB_abs_event[n] ; 
coftcentratfc.event-area^; 

} 

if (canceatrate_evest_area=0) 

DATA SCAB PATH is No. 1. 
else if (concentrate_even_area=0 

DATA SCAN PATH is No. 2. 
else if (concentrate_even_area~2) 

DATA SCAH PATH is So, 3. 
else if (concentrate_evea_area=3) 

DATA SCAN PATH is No, 4. 



(b)definition of selection of data path. 



FIG. 15 
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8x3 block dct coeficients. 
(a)definitiott of LOW FREQUENCY DOHA IN. 

Sdefine BLOCKSIZE 64 

int coef[64]: /* dct coefficients of the current coding block, 
int MASK[64]={0, 1, 1. 1. 1. 0, 0. 0, 

1. 1. I. 1, 0, 0, 0, 0, 

1, 1. 1. 1. 0, 0, 0, D, 

It 1, I, 1- 0, 0, 0, 0, 

1, 0, 0, 0, 0, 0, 0, Q, 

0, 0, 0, 0, 0, 0, 0, 0, 

0. 0. 0, 0, 0, 0, 0, 0, 

0, 0. 0, 0, 0, 0, 0, 0, } ; 

far (i=0; KBLOCKSIZE; i++){ 
low[ i]=coef [i ]*MASK[i ] ; 

} 

for (i = l ; KBLOCKSIZE; 

low_ ac _power + = low[ i]*low[ i] ; 
a I l_ac_power +=coef [i]*coef [ i ] ; 

} 

if (low_ac_power/17^ LITTLE AC THRESHOLD II 

Iow_ac_power/alI_ac_power^AC-CONCENTRATE_THRESHOLp) 
return (apply_DCT) ; 

} 

LITTLE_AC_THRESH01D=64; 
AC_COMCENTRATE_THRESHOLD=0. 95 ; 
these vallues under study. 

FIG. 21 
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x82. x61. X60. X59. x58. x57. x56. x48. x40. x32. 124. X16. 
X8. X0.xl.x2. 13.I4. x5.x6j: 



pixels for estimation of base. 



FIG. 22 
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t(0).tCl).t(2J.t(3).tU).t(5).t(6).tC7).t(a).t(9) tC32).t(33).l(3i) 

|l 

J 



4 



sean(2) and sua_abs-dif f (2) 
meant 1) and sua_abs_di f f ( 1) 
aean(O) and sum_ abs_di f f (0) 

mean(26) and sum_abs_di-f f (26) ^ 
mean (27) and sum_ahs_df ff C27) 



taeanO and sum.abs.dlf f ( ) . 



(A) 



The case of basel i = No. 25 

HH : area of pixels using calculation 
of basel=mean[25j . 

| | : area of pixels using selection 
of base2. 

i.e. base2 is selected from 
lmean[i } :8 £ i £ 14}. 



8x8 block pixels 



An example of calculation of base2. 
(B) 



edge block detection 

FIG. 23 
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gdefine N_PIXEL_oneARBA 8 

It define fLAREA 28 

#define fLDIFF-oneAREA 7 /*<H_PIXEl_oneAREA-l)»/ 

Sdefine N_SELECT_PIXEL 35 

int abs_diff [ff_SBLECT_P!XEL-l] : 

int nean[8_AREA*2], sum_abs_dif f [N_AREA*2] 5 

/» 

calculation mean[], sura-afas— dif f [] 
*/ 

for (i=0; i<»_SELECT_PIXEL-i: i++){ 
abs.diff [i] = abs(t[i + l]-t [i]) ; 

\ 

for (i=0: i<N_DI?F_oneAREA: i++) { 
diff-buff += abs_diff[i]: 

) 

sum_abs_diff [0]=dif f_buf f : 

for (i=0: i<N_PIXEL_oneAREA; i++){ 
suo_buff +~ t[i]; 

} 

mean[0]= (double) sum_buff/N_PIXEL_oneAREA; 

f or { i = l ; i <N_AREA: i++) { 

diff_buf f*dif f_buff-abs_diff [i-l]+abs_di f f Ci+N_DIFF-oneAREA-l] 
s u m_a b s _d i f f [ i ] =d i f f_b u f f ; 

sum_buf f =sum_buf f-t[i-L]+t[i+N_PIXBL_oneAREA-l] ; 
mean[i]= (doub le) sum_buf f/N_PIXEL_oneAREA; 

} 

/» 

APPEND data 
*/ 

for (i=H_AREA; i<N_AREA*2; 
meanCi] =mean[i-N_AREA] ; 
sum abs_di f f [i]=3un_abs_dif f [i-fLAREA] ; 

> 

FIG. 24 
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